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(54) Image processing for medical imaging 

(57) A method for reconstructing an image repre- 
sentation of a subject from data sets collected using a 
medical imaging apparatus is provided. The method in- 
cludes defining operations which are performed in re- 
constructing desired types of image representations. 
The operations are applicable to data sets having par- 
ticular formats. Data sets having particular formats are 
identified, and operations are selected (250) from the 
defined operations based upon the particular format of 
the identified data sets. When a detected load on avail- 
able image processing equipment is below a desired 
level (220), then selected operations are automatically 
performed on the identified data sets. 
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Description 

[0001] The present invention relates to the field of 
medical imaging. It finds particular application in con- 
junction with diagnostic imaging apparatus such as nu- 5 
clear or gamma cameras of the type used in single pho- 
ton emission computed tomography (SPECT), whole 
body nuclear scans, positron emission tomography 
(PET), etc., and will be described with reference thereto. 
However, it is to be appreciated that the present inven- io 
tion is also amenable to other like applications and other 
imaging modes. 

[0002] Diagnostic nuclear imaging is used to study a 
radionuclide distribution in a subject. Typically, in 
S PECT for example, one or more radiopharmaceuticals *5 
or radioisotopes are injected into a subject. The radiop- 
harmaceuticals are commonly injected into the subject's 
blood stream for imaging the circulatory system or for 
imaging specific organs which absorb the injected radi- 
opharmaceuticals. One or more gamma or scintillation 20 
camera detector heads . typically including a collimator, 
are placed adjacent to a surface of the subject to monitor 
and record emitted radiation. The camera heads typi- 
cally include a scintillation crystal which produces a 
flash or scintillation of light each time it is struck by ra- 25 
diation emanating from the radioactive dye in the sub- 
ject. An array of photomuftiplier tubes and associated 
circuitry produce an output signal which is indicative of 
the (x, y) position of each scintillation on the crystal. Of- 
ten, the heads are rotated or indexed around the subject 30 
to monitor the emitted radiation from a plurality of direc- 
tions to obtain a plurality of different views. The moni- 
tored radiation data from the plurality of views is recon- 
structed into a three dimensional (3D) image represen- 
tation of the radiopharmaceutical distribution within the 35 
subject. 

[0003] Generally, a complete diagnostic nuclear im- 
aging study includes the coordination of several steps 
in order to achieve clinically significant and useful re- 
sults. Those steps can be broken down as follows: pre- 40 
paring the subject including injecting the subject with the 
radioactive dye, positioning the subject properly in rela- 
tion to the imaging apparatus, acquiring the data, 
processing and presenting the images, clinical interpre- 
tation, and optionally archiving of the images. *5 
[0004] The image processing can be computationally 
complex and relatively time intensive and so it is typi- 
cally carried out by a computer system. In previously de- 
veloped diagnostic imaging techniques, in addition to 
overseeing the other steps of the imaging study, image 50 
processing or reconstruction is explicitly directed and at- 
tended to by a technician or other trained user. That is 
to say, the technician identifies the data to be processed 
and the processing operation or operations to be applied 
thereto to achieve a particular result, and manually links 55 
them together to begin processing by the computer sys- 
tem. Consequently, in addition to the time spent on the 
other steps of the study, more of a technician's valuable 
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time is taken up for conducting or directing the image 
processing. 

[0005] Moreover, typically once the image processing 
is started the systems resources are unavailable to per- 
form other tasks, perhaps higher priority tasks (e.g., an- 
other imaging study), until the specifically requested im- 
age processing is complete. One solution to this prob- 
lem (i.e., in order to have system resource available un- 
der these circumstances) is to design the computer sys- 
tem for some peak load which is higher than the average 
load and that could accommodate the parallel tasking. 
However, such an approach is inefficient insomuch as 
over time the computer system may be idle for extended 
periods of time and the additional resources would not 
therefore be fully utilized. 

[0006] In accordance with one aspect of the present 
invention, a method for reconstructing an image repre- 
sentation of a subject from data sets collected using a 
medical diagnostic imaging apparatus is provided. The 
method includes defining operations which are per- 
formed in reconstructing desired types of image repre- 
sentations. The operations are applicable to data sets 
having particular formats. Data sets having particular 
formats are identified, and operations and selected from 
the defined operations based upon the particular format 
of the identified data sets. After detecting a load on avail- 
able image processing equipment, the selected opera- 
tions are automatically performed on the identified data 
sets when the detected load is below a desired level. 
[0007] In -accordance with another aspect of the 
present invention, a medical diagnostic imaging system 
includes at least one imaging station. The imaging sta- 
tion includes an imaging scanner which collects image 
data from a subject positioned therein, and a control ter- 
minal from which the imaging scanner is operated. The 
control terminal includes a computer having a particular 
amount of resources for operation of the imaging scan- 
ner and image processing. The computer automatically 
carries out image processing when sufficient resources 
are available and a data set is detected for which an 
image processing operation is applicable. 
[0008] Ways of carrying out the invention will now be 
described in detail, by way of example, with reference 
to the accompanying drawings, in which: 

FIGURE 1 is a diagrammatic illustration of a medi- 
cal diagnostic imaging apparatus and control termi- 
nal in accordance with aspects of the present inven- 
tion; 

FIGURE 2 is a diagrammatic illustration of an ex- 
emplary image processing tree in accordance with 
aspects of the present invention; 

FIGURE 3 is a flow chart showing a method of au- 
tomatic image processing in accordance with as- 
pects of the present invention; and 
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FIGURE 4 is a diagrammatic illustration of multiple 
imaging station networked together in accordance 
with aspects of the present invention. 

[0009] With reference to FIGURE 1 , a medical diag- 
nostic imaging apparatus 1 0 is a nuclear medicine scan- 
ner that produces scintigraphic images, for example, 
SPECT scanners or PET scanners. More generally, the 
imaging apparatus 10 could be any appropriate device 
that detects and records the spatial, temporal, and/or 
other characteristics of emitted photons. Optionally, the 
medical diagnostic imaging apparatus 10 could operate 
via a different imaging mode, e.g., magnetic resonance 
imaging (MRI), computed tomography (CT), etc. 
[0010] For illustrative purposes herein, as shown in 
FIGURE 1 , the diagnostic nuclear imaging apparatus or 
scanner 10 is a gamma camera or SPECT scanner in- 
cluding a subject support 12, such as a table or couch, 
which supports a subject being examined and/or im- 
aged, such as a phantom, a patient, or the like. Alter- 
nately, a PET scanner or other such imaging apparatus 
for the generation and/or collection of projection data is 
employed. In any event, with reference to a SPECT 
scanner, the subject is injected with one or more radi- 
opharmaceuticals or radioisotopes such that emission 
radiation is emitted therefrom. Optionally, the subject 
support 12 is selectively height adjustable so as to cen- 
tre the subject at a desired height. A first gantry 1 4 holds 
a rotating gantry 16 rotatably mounted thereto. The ro- 
tating gantry 1 6 defines a subject-receiving aperture 18. 
In a preferred embodiment, the first gantry 14 is ad- 
vanced toward and/or retracted from the subject support 
12 so as to selectively position regions of interest of the 
subject within the subject-receiving aperture 18. Alter- 
nately, the subject support 12 is advanced and/or re- 
tracted to achieve the desired positioning of the subject 
within the subject-receiving aperture 18. 
[001 1] One or more detector heads 20 are adjustably 
mounted to the rotating gantry 16 with varying degrees 
of freedom of movement. Optionally, the detector heads 
20 are circumferentially adjustable to vary their spacing 
on the rotating gantry 16. Separate translation devices 
22, such as motors and drive assemblies (not shown), 
independently translate the detector heads 20 laterally 
in directions tangential to the subject- receiving aperture 
18 along linear tracks or other appropriate guides. Ad- 
ditionally, the detector heads 20 are also independently 
movable in radial directions with respect to the subject- 
receiving aperture 18. Optionally, the detector heads 20 
selectively cant or tilt with respect to radial lines from 
the centre of the subject- receiving aperture 18. Alter- 
nately, a single motor and drive assembly controls 
movement of ail the detector heads 20 individually and/ 
or as a unit. 

[0012] Being mounted to the rotating gantry 16, the 
detector heads 20 rotate about the subject-receiving ap- 
erture 18 (and the subject when located therein) along 
with the rotation of the rotating gantry 16. In operation, 



the detector heads 20 are rotated or indexed around the 
subject to monitor radiation from a plurality of directions 
to obtain a plurality of different angular views. 
[0013] Each of the detector heads 20 has a radiation- 
5 receiving face facing the subject- receiving aperture 18 
that includes a scintillation crystal, such as a large 
doped sodium iodide crystal that emits a flash of light 
or photons in response to incident radiation. An array of 
photomultiplier tubes receive the light and convert it into 
electrical signals. A resolver circuit resolves x, y-coor- 
dinates of each flash of light and the energy of the inci- 
dent radiation. That is to say, radiation strikes the scin- 
tillation crystal causing the scintillation crystal to scintil- 
late, i.e., emit light photons in response to the radiation. 
The photons are directed toward the photomultiplier 
tubes. Relative outputs of the photomultiplier tubes are 
processed and corrected to generate an output signal 
indicative of (1) a position coordinate on the detector 
head at which each radiation event is received, and (2) 
an energy of each event. The energy is used to differ- 
entiate between various types of radiation such as mul- 
tiple emission radiation sources, stray and secondary 
emission radiation, transmission radiation, and to elim- 
inate noise. An image representation is defined by the 
radiation data received at each coordinate. The radia- 
tion data is then ultimately reconstructed into an image 
representation of the region of interest. 
[0014] Optionally, the detector heads 20 include me- 
chanical collimators 24 removably mounted on the radi- 
ation receiving faces of the detector heads 20. The col- 
limators 24 preferably include an array or grid of lead or 
otherwise radiation-absorbent vanes which restrict the 
detector heads 20 from receiving radiation not travelling 
along selected rays in accordance with the data type be- 
ing collected (i.e., parallel beam, fan beam; and/or cone 
beam). 

[001 5] One or more radiation sources 30 are mounted 
across the subject-receiving aperture 18 from the detec- 
tor heads 20. Optionally, they are mounted between the 
detector heads 20 or to the radiation receiving faces of 
opposing detector heads 20 such that transmission ra- 
diation from the radiation sources 30 is directed toward 
and received by corresponding detector heads 20 on an 
opposite side of the subject-receiving aperture 18. In a 
preferred embodiment, the collimators 24 employed on 
the detector heads 20, in effect, collimate the transmis- 
sion radiation. That is to say, the collimators 24 restrict 
the detector heads 20 from receiving those portions of 
transmission radiation not travelling directly (for parallel 
beam configurations) toward the radiation receiving fac- 
es of the detector heads 20. Alternately, other collima- 
tion geometries are employed and/or the collimation 
may take place at the source. 

[0016] In a preferred embodiment, the radiation 
sources 30 are line sources each extending the axial 
length of the respective detector heads 20 to which they 
correspond. Preferably, the lines sources are thin steel 
tubes filled with radionuclides and sealed at their ends. 
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Alternately, the radiation sources 30 are bar sources, 
point sources, flat rectangular sources, disk sources, 
flood sources, a tube or vessel filled with radionuclides, 
or active radiation generators such as x-ray tubes. Al- 
ternately, one or more point sources of transmission ra- 
diation may be utilized. 

[0017] The medical diagnostic imaging apparatus 10 
is operated via a control terminal 40. Preferably, the con- 
trol terminal 40 includes a computer 42 having a central 
processing unit (CPU), memory (e.g., random access 
memory (RAM)), a data storage device (e.g., a magnetic 
disk drive), video monitor, and one or more input devices 
(e.g., a keyboard, mouse, etc.). The computer 42 is used 
directly by a technician and/or appropriately pro- 
grammed to run imaging experiments on the medical di- 
agnostic imaging apparatus 10. Additionally, during an 
imaging experiment the control terminal 40 is used to 
collect image data from the medical diagnostic imaging 
apparatus 10 and store it in data sets for processing by 
the computer 42. 

[0018] More specifically, the computer 42 recon- 
structs a desired image representation of the subject by 
performing various operations on the data sets, such as, 
e.g., sorting, rebinning, filtering, scaling, interpolating, 
convolving, backprojecting, transforming, weighting, 
and other like operations. Generally, a series of opera- 
tions are performed in succession to process the initial 
raw data collected from the medical diagnostic imaging 
apparatus 10 into the desired image representation. 
[0019] At the time of initial collection and after each 
operation, the data sets take on a characteristic format, 
and for any given imaging experiment performed, there 
are generally a number of different types of image rep- 
resentations that are optionally reconstructed there- 
from. Each of the different reconstructed images makes 
available different medically valuable diagnostic infor- 
mation. Consequently, the selection of which operations 
to perform depends on the format of the data sets and 
the type of image representation desired. 
[0020] With further reference to FIGURE 2, a data 
processing tree 100 illustrates the manner in which dif- 
ferent image representations are reconstructed from a 
data set depending on the processing branch or path 
taken. In this example, an initially collected data set in 
its characteristic format, represented by reference nu- 
meral 1 10, is optionally reconstructed into four different 
image representations, represented by reference nu- 
merals 120a-d, by performing different series of opera- 
tions on the data set. Along the way, the data set takes 
on a new characteristic format, represented by refer- 
ence numerals 130a-h, after each operation, represent- 
ed by the connecting line segments 140a-L Therefore, 
the series of operations selected or processing branch 
or path chosen determines which of the. image repre- 
sentations 120a-d is reconstructed. 
[0021] In accordance with a preferred embodiment of 
the present invention, reconstruction or other image 
processing is automatically initiated when system re- 



6 

sources are available and when there exists a data set 
to which an operation or operations are applicable. More 
specifically, with further reference to FIGURE 3, at step 
200, the image processing or reconstruction starts and 
5 the computer 42 is initialized therefor. At step 210, the 
load on the computer 42 is detected. That is to say, the 
system resources (e.g., available memory, available 
processor time, etc.) of the computer 42 are monitored 
to determine the load on the system. Generally, at any 
10 given time : if an imaging experiment is being conducted, 
or other image processing or reconstruction operations 
are already being performed, the load on the computer 
42 is high or significant. On the other hand, if the com- 
puter 42 is idle, the load is small or insignificant. 
15 [0022] Next, at decision step 220, it is determined if 
the load is at or beneath a predetermined or otherwise 
selected level indicating an availability of resources to 
perform image processing or reconstruction operations. 
Accordingly, if the load exceeds the level such that the 
20 determination at decision step 220 is no or negative, 
then the computer's resources are being otherwise uti- 
lized and the process loops back to step 210. On the 
other hand, if the load is at or beneath the level such 
that the determination at step 220 is yes or affirmative, 
25 then the computer's resources are not otherwise en- 
gaged and the process proceeds to step 230. 
[0023] At step 230, a data set is checked for or other- 
wise identified; The data set is either an originally col- 
lected set of raw data or a data set that has already been 
30 partially processed or operated on and stored. At deci- 
sion step 240, it is determined if a data set was found. 
If no data set is found such that the determination at 
decision step 240 is no or negative, then there is no im- 
age processing or reconstruction to perform and the 
35 process loops back to step 21 0. On the other hand, if a 
data set is found such that the determination at decision 
step 240 is yes or affirmative, then there is image 
processing or reconstruction to be performed and the 
process continues on to step 250. 
40 [0024] At step 250, based upon the characteristic for- 
mat of the identified data set, an operation is selected 
which is appropriate for advancing the data processing 
or reconstruction in the direction of a desired image rep- 
resentation. Thereafter, at step 260, performance of the 
45 selected operation on the identified data set begins. At 
step 270, priority instructions are checked for. Such pri- 
ority instructions include those instructions for which ac- 
cess to system resources is urgent or important, e.g., 
instructions from the control terminal 40 that an imaging 
so experiment is about to begin, emergency shut down in- 
structions, etc. 

[0025] At decision step 280, it is determined if a pri- 
ority instruction exists. If no instruction is found such that 
the determination at decision step 280 is no or negative, 
55 then the image processing continues and the process 
moves on to decision step 290. On the other hand, if a 
priority instruction is found such that the determination 
at decision step 280 is yes or affirmative, then the image 
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processing or reconstruction is interrupted and the proc- 
ess continues on to step 300 wherein the current results 
are stored. 

[0026] At decision step 290 ; it is determined if the op- 
eration is complete. If the operation is not complete such 
that the determination at decision step 290 is no or neg- 
ative , then the image processing proceeds to step 310 
wherein the operation continues to be performed on the 
data set until moving on to step 270 when priority in- 
structions are checked for again. On the other hand, if 
the operation is complete such that the determination at 
decision step 290 is yes or affirmative, then the image 
processing or reconstruction is concluded and the proc- 
ess continues on to step 300 wherein the final results 
for the operation are stored. 

[0027] Accordingly, the operation continues to be per- 
formed on the data set until such time as the operation 
is completed or a priority instruction interrupts process- 
ing. Thereafter, the current results are stored at step 
300. After the results are stored at step 300 the process 
ends at step 320. At the end of the process, feedback 
relating to the results is preferably sent to the control 
terminal 40 for access and assessment by the techni- 
cian. At that point either automatically or upon com- 
mand, unused, unwanted, or unsatisfactory results 
which were collected are discarded. Moreover, at that 
point based on the technicians expert reading of the da- 
ta, the technician has the option of manually or other- 
wise applying expressly selected operations to the data 
sets. Optionally, as indicated by the dashed arrow 330, 
the process is automatically restarted upon the comple- 
tion of each cycle. 

[0028] In this manner then, the automatic image 
processing or reconstruction involves determining if re- 
sources are available for an image processing opera- 
tion, and determining if in fact a data set exists on which 
the image processing operation is to be performed. If a 
data set exists and there are sufficient resources avail- 
able, it is automatically determined based on the char- 
acteristic format of the identified data set or sets which 
operation or operations are to be applied thereto to fur- 
ther reconstruction or other image processing toward 
generation of desirable image representations. 
[0029] With the data sets being differentiated by their 
characteristic formats, if more than one data set is 
present and/or more than one operation is applicable, 
preferably, the data set identified and the operation ap- 
plied thereto is chosen based on a predetermined hier- 
archy or an otherwise selected priority scheme. The hi- 
erarchy or priority scheme instituted is optionally one 
that favours identification of data sets nearest to com- 
pletion of an image representation. As well, the hierar- 
chy or priority scheme optionally favours data sets and/ 
or operations which give rise to the most efficient 
processing given the currently available system re- 
sources on the computer 42. 

[0030] In one preferred embodiment, the computer 42 
maintains an historic analysis of the types of image rep- 



resentations employed by technicians accessing the 
control terminal 40. Accordingly, the instituted hierarchy 
favours data sets and/or operations which generate 
those image representations which are historically most 

5 frequently accessed by technicians. 

[0031] Likewise, lower in this hierarchy are data sets 
and/or operations which produce historically less fre- 
quently utilized image representations. Optionally, mul- 
tiple operations are carried out simultaneously and the 

10 percentages of available system resources dedicated to 
each are made to reflect the types of image represen- 
tations historically accessed by technicians. That is to 
say, for example, if historically a particular image type 
is accessed 70% of the time, then 70% of the available 

15 system resources would be dedicated to processing that 
particular image type. 

[0032] Optionally, as best seen in FIGURE 4, multiple 
imaging stations 400 each include a medical diagnostic 
imaging apparatus 10 and a control terminal 40. The 

20 computers 42 associated with each of the control termi- 
nals 40 are linked to one another through a common 
data network 410. In this manner, the networked com- 
puters 42 share the image processing load based on the 
respective availability of their resources. For example, 

25 preferably, in this embodiment, in addition to detecting 
the load on individual computers 42, the load on the net- 
work is also evaluated. Consequently, regardless of the 
terminal 40 at which the data set was collected or oth- 
erwise resides, those computers 42 with available re- 

30 sources are utilized via the network 410 to perform ap- 
plicable operations on the data set for the desired 
processing or image reconstruction. In this manner 
then, when one imaging station 400 is being utilized to 
run an imaging experiment such that the associated 

35 computer 42 is low on available resources, image 
processing can continue to be simultaneously carried 
out over the network 410 on computers 42 at otherwise 
idle imaging stations 400. 

[0033] One advantage of the described system for 
40 computing by anticipation for nuclear medicine imaging 
is that the computer systems used for image processing 
and running imaging experiments is defined in terms of 
an average load rather than a peak load. Another ad- 
vantage is that for image processing it utilizes otherwise 
45 idle computer downtime when imaging experiments are 
not being conducted. Yet another advantage is that high 
efficiency and productivity result from automatically per- 
forming image processing when system resources are 
available. 

so [0034] The invention has been described with refer- 
ence to the preferred embodiments. Obviously, modifi- 
cations and alterations will occur to others upon reading 
and understanding the preceding detailed description. 
It is intended that the invention be construed as includ- 
es jng all such modifications and alterations insofar as they 
come within the scope of the appended claims or the 
equivalents thereof. 



EP 1 099 961 A2 



10 



Claims 



7. 



5. 



A method for reconstructing an image representa- 
tion of a subject from data sets collected using a 
medical imaging apparatus, said method compris- 5 
ing: 

8. 

(a) defining operations which are performed in 
reconstructing desired types of image repre- 
sentations, said operations being applicable to 10 
data sets having particular formats; 9. 

(b) identifying data sets having particular for- 
mats; 

(c) selecting operations from the defined oper- 
ations based upon the particular format of the is 
identified data sets; 

(d) detecting a load on available image 
processing equipment; and 

(e) automatically performing the selected oper- 10. 
ations on the identified data sets when the de- 20 
tected load is below a desired level. 

A method as claimed in claim 1 , said method further 
comprising: storing results from performing the se- 
lected operations on the identified data sets. 25 

A method as claimed in claim 1 or claim 2, said 
method further comprising: defining a hierarchy 
which controls an order in which data sets are iden- 
tified in step (b) and operations are selected in step 30 
(c) when optionsexist as to which datasetto identify 
and which operation to select. 

A method as claimed in claim 3, said method further 
comprising: receiving requests for desired types of 35 
image representations; and historically tracking 
how many times different types of image represen- 
tations are requested. 

A method as claimed in claim 4, wherein the hier- 40 
archy favours identification of data sets in step (b) 
and selection of operations in step (c) such that pri- 
ority in the types of image representations recon- 
structed reflects the historical tracking. 



Medical imaging system as claimed in claim 6, 
wherein the computer (42) is arranged to select im- 
age processing operations for application to partic- 
ular data sets based upon characteristic formats of 
the data sets. 

Medical imaging system as claimed in claim 6 or 
claim 7, wherein the imager (10) is a nuclear scan- 
ner. 

Medical imaging system as claimed in any one of 
claims 6 to 8, said medical imaging system further 
comprising: multiple imaging stations (400); and a 
common data network (410) linking the computers 
(42) from the control terminal (40) of each imaging 
stations to enable an image processing load to be 
shared thereby. 

Medical imaging system as claimed in any one of 
claims 6 to 9, wherein the computer (42) is arranged 
to store clinically useful images resulting from the 
image processing and discards unusable images. 



Medical imaging system comprising: at least one 
imaging station (400), said imaging station (400) in- 
cluding an imager (10) for collecting image data 
from a subject positioned therein; and a control ter- 
minal (40) from which the imager (10) is operable, 
said control terminal (40) including a computer (42) 
having a particular amount of resources for opera- 
tion of the imager (10) and image processing, said 
computer (42) being adapted to carry out automat- 
ically image processing when sufficient resources 
are available and a data set is detected for which 
an image processing operation is applicable. 
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